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In a method of image sub- 
traction a series of frames of a 
subject are taken using a video 
camera. The subject is illumi- 
nated in a manner so that illumi- 
nation is alternately on, then off 
for successive fields within the 
image frame. A single frame is 
grabbed and an absolute differ- 
ence between the odd field and 
the even field within that single 
image frame is determined. The 
resulting absolute difference im- 
age will represent the subject as 
illuminated by the system illumi- 
nation only, and not by any am- , 
bient illumination, and can then 
be used to identify the subject in 
the image. 
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TITLE 

IMAGE SUBTRACTION TO REMOVE AMBIENT ILLUMINATION 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates to a method for removing ambient illumination from 
an image to allow further processing or analysis of the image 

-2- Background of the Invention 

There are several methods known as biometrics for recognizing or 
identifying an individual. These methods include analyzing a signature, obtaining and 
analyzing an image of a fingerprint and imaging and analyzing the retinal vascular patterns 
of a human eye. Recently the art has used the iris of the eye which contains a highly 
detailed pattern that is unique for each individual and stable over many years as a non- 
contact, non-obtrusive biometric. This technique is described in United States Patent No. 
4,641 ,349 to Flom et al. and United States Patent No. 5,291 ,560 to Daugman. The iris 
identification techniques disclosed by Flom and Daugman require a clear, well-focused 
image of the iris portion of the eye. Once that image is obtained a comparison of that 
image with a coded file image of the iris of the person to be identified can be accomplished 
quite rapidly. However, prior to the present invention there has not been an optical system 
which could rapidly acquire a sufficiently clear image of an iris of the person to be 
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identified unless that person positioned his eye in a fixed position relatively close to an 
imaging camera. In a commercial embodiment of this . iris identification the user is 
required to position his eye on an eyepiece. Thisprovides an advantage in that the 
eyepiece eliminates the effects of ambient lighting. It also eliminates the necessity of 
automatic iris image acquisition, since the subjects themselves.are responsible for 
positioning their own eyes at the. proper location for the device to function. However, the 
device is impracucakfor users of automated teUer.maclnnes and for other situations in 
which an individual must be rapidly and. unobtrusively. identified. Yet, when one allows 
the person to be identified to stand away from. the camera lens, ambient . lighting conditions 
suchas background lighting can confuse.and. distract the process of automaticiris 
acquisition, depending on the algorithms used. In.addition,. lighting from. around:the 
subject may obscure portions of the image or create artifacts that prevent identification. 

Ithas been known for many years .that the effects of . lighting could be 
removed by taking two images, one while the iUuminator is on and the second while the 
illuminator is off. Then a pixel by pixel comparison is made between the two images. 
Usually this has involved subtraction of the gray scale values for corresponding pixels in 
the two images. Sometimes pixel values have been enhanced by multiplication of the gray 
scale values or by other mathematical operations. Furthermore, the iUuminators could 
generate visible light, infrared light beams or even X-rays to create the image. Examples 
of such prior art image subtraction are contained in United States Patent Nos. 4,636,850 
and 4,490,037. 
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One problem with the prior.art image subtraction-methods is that one must 
know which of the two images was .made while the illuminators were on.and which was 
made while the illuminators were off. A second shortcoming ofthe:prior:art is that most of 
the techniques require a relatively largememory to store the images andvthe;processing 
:algorithms. Finally, many of the techniques are difficult or impossible to use with video 
cameras. 

There is a need for an image subtraction technique which overcomes these 
shortcomings of the prior.art. This system Avould be particularly useful: to identify users of 
automated teller machines .as well .as individuals seeking access to.a restricted area or 
facility or other.applications requiring user identification. However, for such use to be 
commercially successful, there must be.aTapid, reliable and unobtrusive way to obtain iris 
images of sufficient resolution to permit verification and recognitionfrom an ATM user 
standing in front of the teller:machine, .and :for the obtaining images of the subjects 
themselves to enable automatic iris image. acquisition. To require the user to position his 
head a predetermined distance from the camera, such as by using an eyepiece or other 
fixture or without fbcturing is impractical. Hence, the system must rapidly take and 
process the images so as to eliminate effects caused by movement of the subject. 

SUMMARY OF THE INVENTION 
We provide a method of image subtraction in which we first take a series of frames 
of a subject using a video camera such that each frame will contain an interlaced even field 
and odd field of raster lines. We illuminate the subject in a manner so that illumination is 
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alternately on then off for the two successive fields of an image frame. Then we grab a 
single frame and take. an .absolute difference between the odd field.and the even field. This 
Tesulting absolute difference image will represent the subject.as Uluminated by the system 
illumination only, and not by any ambient illumination, so that the image can be used to 
identify the subject in the image. 

BRIEF DESCRIPTION OF THE FIGURES 

Figure 1 is a diagram showing a subject of whose eye an image is taken with and 
without illumination. 

Figure .2 is an image taken under ambient conditions. 

Figure 3 is an image similar to Figure 2 taken while an illuminator was on. 

Figure 4 is an image taken under illuminated conditions which has been corrected 
to remove the effects of ambient illumination. 

Figure 5 is a diagram showing a small portion of a video image 

Figure 6 is an image of a subject taken under ambient conditions. 

Figure 7 is an image of a subject similar to Figure .2 taken while an illuminator was 

on. 

Figure 8 is an image of a subject taken under illuminated conditions which has been 
corrected to remove the effects of ambient illumination. 
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BRIEF DESCRIPTION OF THE PREFERRED EMROHTlUPMTg 
Referring to Figure 1 we provide* video camera in housing 2 to take an image of 
the eye 10 ofthe subject 1. The camera is positioned so that the eye 1 0 of the subject 1 is 
within the field of view s of the camera. The housing also contains at least one illuminator 
6 and a controller 8. The controller may be.a program contained in a computer which also 
contains programs, and memory forperforming image subtraction .and image analysis. The 
Uluminator directs a light beam 7 onto the area which is being photographed. We prefer to 
-use an infrared light source and an infrared camera. The controller synchronizes the 
camera and illuminator.so that successive picture fields will be alternately illuminated. and 
not illuminated. The video camera will produce a series of field sub-images such as are 
shown in Figures .2 and 3, if one were to de-interlace the even and odd field of an image 
frame. Normal video image frames are made up of a series of raster lines or fields 
indicated bylines 13. Each raster line is comprised of a. set of pixels 23 asshownin 
Figure 5. The fields are grouped according to odd and even raster lines. In the fiame 
shown in Figure 5, either all of the even field pixels are illuminated by the system 
iUumination and the odd field pixels are not, or vice-versa. In either case, both even and 
odd fields are illuminated by ambient illumination. 

The image of Figure 2 was created while the illuminator was off. Ambient lighting 
conditions have created shadows 14 and bright spots indicated by regions 16. In the frame 
of Figure 3 the illuminator was on creating an evenly lit image, although some areas 15 
such as the eyelids may be darker than others. In order to properly identify the subject it is 
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necessary to remove the effects of the ambient lighting to create an image without shadows 
or bright spots.as.shown in Figure 4. We have developed an image subtraction method to 
rapidly remove the effects of ambient lighting. 

In our method we take a single frame and subtract the pixel values in one field from 
thepixel values in the other.fteld. Then we usethe absolute value of that difference as the 
pixel's actualintensity had it been imaged with only system fflumination. The subtraction 
is done between adjacentpixels. For example, in the region shown in Figure 5 pixel 23a 
would be subtracted frompixel23b and pixel 23 c would be subtracted from pixel . 23d. 
Alternatively pixel23b could be subtracted from pixel 23a. and pixel 23 d could be 
subtracted frompixel 23c. Since we.are using the absolute value rather than the straight 
difference it does not matter which of the two fields is subtracted from the other. 

After we have performed image subtraction in this manner we will have a set of 
values thatrepresents the original subject had it been imaged with system illumination but 
without ambient ulumination, effectively removing the unwanted effects of ambient 
illumination. After this process a corrected image such as is shown in Figure 4 will have 
beencreated. If the corrected image is that of the eye or iris of an person to be identified 
the corrected image is then used for identification using the techniques described in United 
States Patent No. 4,641,349 to Horn et al. and United States Patent No. 5,291,560 to 
Daugman. 

The image of Figure 6 was created while the Uluminator was off. The overhead 
lighting can distract and confuse algorithms designed to locate the subject's eye in 3-D 
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space. In the frame of Figure 7 the illuminator was on, clearly illuminating the subject. In 
order to properly locate the subject's eye it is necessary to remove the distracting effects of 
the background lighting as shown in Figure 8. This method of image subtraction can also 
be used to rapidly remove the effects of background ughtmg.and.greatly facilitate the 
process of automatic iris image acquisition. 

Since our method uses only a single frame it has.several.advantages. First it does 
not matter which frame is selected by the frame .grabber. Furthermore, we do not require 
the capture of only one frame with the muniination on and one frame with the illumination 
off which would require that frame capturing be done at video rates. We also do not care 
which field is illuminated so long as one field is illuminated. and one field is not. Hence, 
synchronization of the frame grabber with the camera is easier. 

Another advantage of our method is that we need only store a single frame in 
memory so only half as much memory is needed than is required for conventional image 
subtraction. This is significant because each frame is 640x480 pixels and each pixel has a 
gray scale value. Using one image also reduces the time during which the image must be 
stored. 

Another implementation can reduce the time and memory requirements further by 
half by storing only the first field in memory and performing the absolute difference of the 
corresponding pixel values of the second mcorning video field as it is being digitized, 
without requiring intermediate storage of the full second incoming field. 
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Our method can be used with any type of video camera. However, we prefer to use 
a CMOS (complementary metal-oxide semiconductor) imaging device. CMOS imagers 
have much more isolation between adjacent pixels . than do charge . coupled devices (CCD) 
which are commonly used. As a result in this type of imager there is no blooming which is 
the distortion of the values of pixels adjacent to those which receive bright light. 

While we have described and shown certain present prefen-ed embodiments of our 
method it.should be distmctly.understood that our invention. is not ln^^ 
be variously embodied within the scope ofthe following claims. 
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We claim: 

1 . A method of image subtraction comprising ithesteps of: 

a. :taking a series of frames of a subject using a video camera such that each 
frame will contains even field of raster lines and an oddfield of raster lines; 

:b. illuminating the subject in a manner so that illumination is alternately on 
then off for successive :fields; 

c. grabbing. a frame; ;and 

d. finding an absolute difference between.the odd field and the even field 
thereby creating. ^representation of the subject illuminated by system.illumination without 
ambient illumination. 

2. The method of claim 1 also comprising the step of computing the difference for 
at least one additional selected frame to create a, corrected image. 

3. The method of claim 1 wherein the illumination is performed using an infrared 
light source. 

4. The method of claim 1 wherein the camera is a CMOS device. 

5. The method of claim 1 wherein the image subtraction is performed by a 
computer. 
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6. Themethod of claim 1 wherein only a single frame is stored in memory. 

7. The method of claim 1 wherein the grabbed frame includes an image of an iris 
of the subject:and also comprising the step of applying at least one iris identification 
-algorithm to at least.a-portion of the representation of the subject. 

8. The method of claim 1 wherein the grabbed frame includes an image of a 
subject and also comprising the step of applying an automatic iris acquisition algorithm to 
at least.aTJortion of the representation of the subject. 
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